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This  paper  is  written  In  the  language  of  mathematical  statistics.  Expo¬ 
sitions  for  practitioners  in  Monte  Carlo  will  appear  elsewhere. 

Le  t  ^ 

(i)  ?1(-4r 

be  independent  variables  (the  discuoaion  applies  if  these  r  's  are  random  vectors, 
and  in  applications  we  are  interested  in  vectors,  but  for  ease  of  exposition  we 

■m 

shall  speak  of  rantfora  variables).  We  consider  tho  real  function  of  n+1  real 
variables 


l 

* 


(2)  y  *=  y(xj.,  , -n 

We  are  interested  in 

(3)  E(y), 

the  expected  value  of  y  as  a  function  on  tire  probability  space  of  the  tj'e 
Lot 

(h)  f  J ,  1- 1 , .  • . , n 
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bo  random  vnriublco  such  that  Tor  every  measurable  oet  A,  the  probability  that 
la  In  A  io  zero  If  and  only  if  the  probability  that  ^  la  In  A  la  olao  zero. 
Thuo  with  probability  1,  a  a ample  vnlue  from  either  of  ^  and  could  have  arisen 
as  a  sample  value  from  the  othor. 

We  shall  define  weight  functions 

i-l»  •••>» 

such  that 

(5)  B(y)  -  e'  (y  ft  ^ 


where  E'  denotes  expected  value  under  tho  probability  measure  of  x^, x. 
If  and  |i|  are  the  probability  measures  for  the  unprimed  and  primed  random 
variables,  respectively,  we  take 


(6) 


Let  un  now  indicate  vhnt  we  are  trying  to  do.  We  are  given  (l)  and  (e). 

We  wish  to  estimate  (3).  This  estimate  could  be  made  by  Monte  Carlo  analysis, 
that  is,  by  means  of  simple  random  sampling  from  the  Joint  distribution  of  the 
random  variables  (l).  however  in  the  light  of  (9);  we  would  like  to  define  random 
variables  (4)  such  that  the  variance  of  yj^sj  over  the  probability  space  of  the 
primed  random  variables  is  less  than  that  of  y  over  the  space  of  the  unprimed 
variables.  We  shall  speak  of  tho  f |  us  the  distorted  variables  and  the  ^  as  the 
undictorted  variables.  Thuo,  in  estimating  E(y)  we  distort  distributions  of 
random  variables  to  achieve  greater  efficiency. 
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Let  ua  indicate  further  the  motivation  of  the  analysis  to  bo  developed  below. 
Suppooe  that  the  probability  density  of  ^  is  X  exp(-Xx),  with  x  nonnegative. 

Suppose  tliat  y  ia  practically  aero  unless  is  very  large.  Then  in  undiotorted 
sampling  one  would  require  a  large  sample  because  only  sample  values  in  the  tail 
of  the  distribution  of  ?  ^  give  much  information.  This  suggests  tliat  one  ai&ht 
introduce  with  probability  density  X*  exp(-X'x)  with  X'  smaller  than  X;  in 
this  way  one  would  get  more  sample  vulues  located  in  the  tall  of  the  distribution 
of  j^.  hut  the  choice  of  X*  is  not  easy.  Let  us  assume  that  a  value  of  X'  was 
selected  and  a  sample  drawn  from  the  distorted  distributions,  and  that  this  selection 
and  this  sampling  were  done  prior  to  the  discussion  of  the  present  memorandum. 

Our  objective  below  is  to  use  the  sample  data  to  date  mine  a  new  X',  say  X"  which 
will  yield  greater  efficiency  than  X'. 

Let  us  write  (still  digressing)  . 
ft)  ‘  X"  =  X  +  (l+a)  (X'-X). 

We  shall  seek  a  good  value  to  use  for  o.  We  note  that  (6)  with  the  subscript  i 
deleted  specializes  to 


(3) 


X  exp(-Xx) 

X"  cxp(-X,'x}  ' 


and  tliat  there  is  a  similar  expression  with  primes  in  place  of  the  double-primes. 
For  purposes  to  come  to  light  below  we  calculate  using  (7)  and  (8)  that 


*  xTTT+arTxT.IT  exp  [(r*x)  x] 


- - exp  ((l+c)  (X'-X)  x] 

1+  ( l+Oi)“j"“ 
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i.L'  X 1  -X  is  sufficiently  can.ll , 


exp  [  ( li-O )  (X'-X)  xj, 


*{ 


exp  t(X'-X)  x) 


|l+o 


/  I \l+o 
«  (*') 

(see  (8)  with  primes  in  place  of  the  double  primes). 


The  significance  of  this  relation  is  the  following.  The  difference  X'-X 
measures  the  amount  of  distortion  in  the  use  of  X*  in  piece  of  X.  If  the  amount 
of  the  distortion  is  increased  by  a  email  amount  a(X'-X),  the  weight  function 
is  raised  to  the  power  1+a  approximately.  This  same  approximate  power  law  holds 
for  distortions  of  other  commonly  used  distributions. 

Let  ua  now  return  to  the  serious  development  of  the  paper.  We  ansumc  that 
corresponding  to  each  set  (o^  ,  ...,0:  )  of  real  numbers  near  (0, ...,0)  there  ie  a 
set  of  random  variables 

C.  ^  ,  i- 1,  •  •  • ,  n, 

such  that  i or  o^*0,  i=l,  «».,n,  the  double-primed  variables -reduce  to  the 

•ind  such  tliat  the  corresponding  weight  functions  satisfy 

1+0 . 

(9)  v'l  «  (w|)  1 

where,  as  above,  the  v»  are  the  weight  functions  for  the  n  . 

We  shall  estimate  (y) .  ‘fating  into  •account  (9),  we  write 
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E(y)  «  /"  y  ft  wi 

J  i«l 

whore  pj'  la  the  probability  measure  Tor  .  From  (6)  and  the  similar  relation 
with  primes  replaced  by  double -primes,  we  obtain 

w£  dp^  =  dp^ 

which  together  with  (9)  gives 

-a. 

dp^  «  (vp  1  dp'  . 

The  above  integral  for  E(y)  reduces  to 

E(y)  -  Jy  I]  W^WP  1  d^i  t 

which  with  further  use  of  (9)  becomes 

E(y)  -  f  y  II  wi  • 

Eul  this  is  nothing  but  (5)< 

What  we  are  interested  in  is  the  variance  of  t  *  y  ]]  w^  ,  which  by  calculations 
like  those  just  completed  is  obtained  from  (we  introduce  notation  used  below) 

t  9  e"  (t?)  ^  k"  j^<y  n  wp?  j-  / y2  n  (wiY  (wi) 1 S 

(10)  =  J  yS  JJ  fwp)  1  dp'  . 

3ince  tlie  expected  value  of  t  is  constant  with  respect  to  the  O^,  our  objective 

O 

will  be  to  minimize  E" ( t£ ) .  The  utility  of  the  last  expression  results  from 
the  fact  that  it- involves  the  weights  and  men  mires  of  random  variables  which 
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have  already  been  sampled.  Thus  using  the  sample  from  the  we  shall  be  able 
to  pick  out  a  good  values  of  the  to  be  used  in  further  sampling. 

In  practice  the  relation  (9)  is  only  usable  vhen  the  are  small.  Hence 
the  same  is  true  of  (10).  We  shall  calculate  the  derivatives  of  (10)  with  respect 
to  the  0^  at  a4  *  0,  i*l,..., n,  and  use  a  quadratic  approximation  for  (lO). 

Differentiation  under  the  integral  sign  leads  to  the  following  derivatives 

p 

which  have  been  evaluated  at  0^*0.  Let  T  denote  E"(t  ). 


We  have 


cn 


cjk  *  dajdo^ 


J y2  log  wj  [{  (wp2  dpj  , 

m  f y2  ^ioe  wp2  n  > 

“  J y2  log  wj  log  w£  [[  (wj)2  dpj 


T-TI(V. (0,...,0)  *  Z  “j  °J  +  5  Z  ZCJk  “j  °k  • 


The  minimum  of  T  occurs  at  the  solution  of 
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